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Abstract 

In this paper we derive the properties for the operator representation of the multivariate dependence 
theorem attributed to Sklar which describes the unique representation of general dependence structures 
linking marginal distributions. We develop this in the context of multidimensional correlated Markov 
diffusion processes, in the process defining the copula infinitesimal generator which we interpret as a 
functional copula specification of Sklars theorem extended to representations involving multivariate gen¬ 
eralized diffusion processes. This allows us to develop a copula function mapping framework which we 
demonstrate can be accurately and efficiently obtained under a discretization scheme proposed. We show 
the discretized approximate copula function mapping has a limiting form which produces any desired 
dependence structures, induced by local correlation approximations obtained from the multivariate gen¬ 
eralized diffusion at all local points in the state space. Hence, we achieve what we denote the functional 
specification of the copula mapping in operator space via tensor decomposition approaches obtained from 
the mimicking generalized diffusion process. 

We investigate aspects of semimartingale decompositions, approximation and the martingale represen¬ 
tation for multidimensional correlated Markov processes. A new interpretation of the dependence among 
processes is given using the martingale approach. We show that it is possible to represent, in both contin¬ 
uous and discrete space, that a multidimensional correlated generalized diffusion is a linear combination 
of processes that originate from the decomposition of the starting multidimensional semimartingale. This 
result not only reconciles with the existing theory of diffusion approximations and decompositions, but 
defines the general representation of infinitesimal generators for both multidimensional generalized dif¬ 
fusions and as we will demonstrate also for the specification of copula density dependence structures. 
This new result provides immediate representation of the approximate solution for correlated stochastic 
differential equations. We demonstrate desirable convergence results for the proposed multidimensional 
semimartingales decomposition approximations. 

Keywords: Martingale Problem, Martingale Representation, Semimartingales Decomposition, Tensor 
algebra. Copula Functions, Copula Infinitesimal Generators, Multidimensional Semimartingales Decom¬ 
position Approximations, Diffusion Approximation Convergence. 
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Introduction 


1 Introduction 

We consider the multidimensional stochastic differential equation (SDE) of the form 

dXt = b{t,Xt)dt + i:{t,Xt)dWt, (1) 

where b{t,Xt) : [0,oo) x —>■ and H{t,Xt) : [0, oo) x —>■ and we assume that b = (bj) is 

continuous vector valued function and S = ((E^)) is a continuous, symmetric, nonnegative definite, dx d 
matrix valued function. Let the infinitesimal generator associated to the SDE of eq.(l) be denoted, 

d d 

^ = {(/, G/ = - ^ Sya.9,/ + ^ bAf) : / G Gr(K")}, (2) 

ij i 

where (M'^) denotes the sets of smooth functions with compact support on The aim of our work is 
to address problems in settings which may involve potentially very high dimensional state spaces which 
display non-trivial dependence structures, as specified by generalized multivariate correlated diffusion 
processes. We propose two ways to calculate the weak solution of the SDE in eq.(l) in an approximate 
manner: 

1. Direct approximation of the infinitesimal generator A with particular emphasis in the structure of 
its mixed derivative terms. 

2. Decomposition of the infinitesimal generator A into orthogonal components. 

The approximation schemes we propose are based on tensor algebra decompositions such as those con¬ 
sidered in [35]. The novelty we introduce consists in the introduction of new concepts like the cop¬ 
ula infinitesimal generator, correlated tensor representation, conditional infinitesimal generator and the 
framework developed to perform a parametric copula function mapping as will be detailed in the remain¬ 
der of the paper. In general the proposed results aim to develop a new characterization of the cross space 
among dimensions using tensor algebra. Furthermore, our schemes are supported by approximation and 
convergence results that constitute a little utilised perspective to look at solutions of multidimensional 
SDEs. 

Our investigation is focused on aspects of the semimartingale decomposition and martingale repre¬ 
sentation for multi-dimensional correlated Markov processes. The objective is to construct a continuous 
time Markov chain (CTMC) that approximates or mimicks such processes and their dependence struc¬ 
tures induced throughout the state space, which are only implicitly defined by the joint structure of the 
marginal process volatility functional forms and the joint coupling of the correlation structures in the 
driving noise processes. Once such a mimicking process is obtained we may then transform it structure 
to produce a copula function mapping theorem that allows one to obtain structural characterizations of 
general dependence frameworks, through the specification of the mimicking multivariate diffusion process. 

This work is motivated by the problems of finding the expression of a multi-dimensional CTMC that 
both closely follows the dynamics of the corresponding correlated Ito-processes and also can effectively 
deal with the representation and simulation of large dimensional processes that exhibit various correlation 
structures. Although the literature on Markov processes and Markov chains is very rich and mature, 
see [41, 39, 49], we find that there is still room for further investigatation and characterization of multi¬ 
dimensional chains and the relationship between the correlation structure among marginal Markov chains 
and dependence concepts like copula functions [47] and concordance measures of dependence [16, 45]. In 
fact these concepts have always been treated separately, and there is lack in literature of a theory that 
reconciles them. 

Our findings and results show that our approach, based on linear and tensor algebra, is a powerful way 
to produce accurate solutions of multidimensional correlated SDEs that exhibit a correlation that can 
be fully modelled through copula functions. Specifically given a multi-dimensional Ito processes whose 
drift and diffusion terms are adapted processes, we show how to construct the approximated infinitesimal 
generator and how to characterize the process properties by its associated continuous time Markov chain 
(CTMC). We construct an approximated weak solution to the stochastic differential equation that weakly 
converges to the distribution of the multi-dimensional Ito processes. 
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Martingale problems for correlated Markov Processes 


We develop an interpretation for the correlation among processes using the martingale approach 
applied to the study of diffusions. The novelty is that it is possible to represent, in both continuous 
and discrete space, that a multidimensional correlated generalized diffusion is a linear combination of 
processes that originate from the decomposition of the starting multidimensional semimartingale. 

The only assumption required by our approximation approach is that the martingale problem for the 
associated generator of the multidimensional Markov process is well posed. [40] formulated the martingale 
problem as a means of studying Markov processes, especially multidimensional diffusions. This approach 
is deemed to be more powerful and more intrinsic than the alternative approaches represented by the 
Markov process approach and the Ito approach. 

Our result reconciles with the existing theory of diffusion approximations and decompositions existing 
in the probability literature and is more closely related to the work of [28] and more recently to [29]. In 
the seminal manuscript [28] considers a multi-dimensional Ito process, and constructs a weak solution 
to a stochastic differential equation which mimics the marginals of the original Ito process at each fixed 
time instant. The drift and covariance coefficients for the mimicking process can be interpreted as the 
expected value of the instantaneous drift and covariance of the original Ito process, conditional on its 
terminal value. In [29] the authors extend the result of [28], proving that they can match the joint 
distribution at each fixed time for various functionals of the Ito process. The mimicking process takes the 
form of a stochastic functional differential equation and the diffusion coefficient is given by the so-called 
Markovian projection. In our framework we further generalize findings from [29] and the mimicking 
process takes form of a sequence of conditional continuous time Markov chains with instantaneous drift 
and diffusion coefficients given by projected instantaneous local moments. 

The results reported in this manuscript define the general representation of the approximated in¬ 
finitesimal generators for both multidimensional generalized diffusions and for what we will define as the 
function copula specification. 

The paper is organized as following: Section 2 introduces the martingale problem for correlated Markov 
processes. In Section 3 we introduce and characterize the approximation schemes for the infinitesimal 
generator of correlated Markov processes while in Section 4 we proposed some desirable convergence 
results of our approximations. 


2 Martingale problems for correlated Markov Processes 

Our analysis takes place on a measure space (0,7^,^), where p is a non zero u-finite, positive measure 
on the measurable space (O, J^). We denote by ||/||p for p S [l,oo], the LP{p) norm of a function /: 
ll/llp = / \f\^dp. Furthermore we define the Markov semigroup {Pt{x,dy)) on a countable set E as the 
family of probability transition kernels on E depending on the parameter t G [0,oo), such that 

/ Ps{x,dy)Pt{y,dz) = Ps+t{x,dz), for s,t G [0,oo), (3) 

Jy€E 

and its action on bounded and positive functions is denoted by 

Ptf(x) = J f{y)Pt{x,dy)- (4) 

The family of operators Pt satisfies the following axioms Pq = I, Pto Pg = Pt+s, limi_,,o+ \\Ptf — f\\ = 0. 
Markov processes are naturally related to Markov semigroups because the probability measure Pt{x, dy) 
with Ptf{x) = E^[f{Xt)] is the law of the process itself starting from the value x at time 0. We 

assume in this paper that the measure p is an invariant measure for the semigroup Pt, and this means 
that for all / G L^{p), 

J Ptf{x)p{dx) = J f{x)p{dx), 

and that Pt is a contraction semigroup in M{p) for all t. We define the infinitesimal generator of a 
strongly continuous contraction semigroup by the map 

Af:= hm (5) 

*—>• 0 + t 
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Martingale problems for correlated Markov Processes 


for all / S Dp, with Dp a dense set of right continuous left limit (rcll) functions that is a subspace of 
U‘{p). The properties of A and Dp entirely specify the semigroup Pt. In fact given / € Dp the function 
U{x,t) = Ptf{x) is the unique solution of the equation 


dU{x, t) 
dt 


AU{x, t), 


( 6 ) 


defined in Dp for alH > 0 and with U{x,0) = v, the initial probability distribution. We restrict ourself 
to the set of compactly supported functions denoted by and belonging to the set D (- Dp and 

we study only generators of local diffusions of the form 


“ a 1 “ a2 

A, = J 2 bi{s,x)— + -'^T,ij{s,x)- 




dxidxi 


(7) 


, where b = (6i(s, x)), i = 1, ..., d is a drift vector and E = ((Ei^-)), i, j = . ,d \s & dispersion matrix 

with E = CC that characterize locally stochastic differential equations (SDE) with expression 

Xt=Xo+ [ b{s,Xs)ds+ [ C{s,Xs)dWs, (8) 

Jo Jo 

where IT is a d-dimensional Brownian motion. We note that the dynamics of Xt are characterized 
completely by the infinitesimal operator and therefore by the laws of the drift and diffusion coefficients, 
including the conditional probability law. In particular the infinitesimal operator in eq.(20) is specified 
also by such coefficient with an explicit expression. In this respect the connection between the generator 
of Xt and the solution of the SDE for Xt has a rigorous formulation given by the Martingale problem of 
[40] . It is straightforward to show the connection between the differential operator A and the probabilistic 
interpretation of the solution to the corresponding SDE. If / € then Ito’s Lemma yields 

fix{t)) = f{X{0)) + f Af{X{s))ds + f V/(X(s))V(X(s))dW(s). (9) 

^0 Jo 

This means that ^ 

f{Xt) - f{Xo) - [ Af{x,)ds, (10) 

is a local martingale. In particular the processes 

b{X{s))ds = f a{X{s))dW{s)^ (11) 

Jo 

Mi Mi - [ a,jiXs)ds, ( 12 ) 

Jo 


Mt = X{t)-X{0)- 


are local martingales. 

Definition 1. A probability measure v on ((^[O, oo)'^, ,B(C'[0, 00 )“^)) under which 

Mf{t) = fiXt) - fiXo) - f Asf{Xs))ds (13) 

Jo 

is a martingale for every f € D, and is called a solution to the martingale problem associated with the 
operator At, where At is as defined in eq.(7). 

In addition, it will also be useful to observe the following representation and uniqueness results 
regarding the process Xt and the infinitesimal operator At, as detailed for instance in [40]. 

Theorem 1. The process Xt is a weak solution to the SDE of eq.(l) if and only if it satisfies the 
martingale problem of eq.(l) with At as the infinitesimal operator of Xt as defined in eq.(7). 
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Approximation of Correlated Markov Processes 


Another fundamental result we mention that is directly relevant background to the framework we 
develop is that given by the following theorem. 

Theorem 2 (Uniqueness of SDE solution.). [ 4 O, Th. 3.2.1.] The SDE 

dXt =b{Xt)dt + C{Xt)dWt, 0<t<s, Xo = n, (14) 

with V a random variable independent from Wt, t>0 and E[|i/p] < 00 , has unique solution adapted to 
the filtration generated by Wt and v if the measurable functions b{x) and C{x), for t < s, satisfy the 
following two conditions: 

1. Lipschitz continuity 

\b{x)-b{y)\ + \C{x)-C{y)\<K{\x-y\), for all x,y , (15) 

2. Linear Growth 

|6(x)| + |C'(a;)| < Ar(l + |a;|), for all x € . (16) 

Having developed the general theoretical construct for the processes we will be working with, we may 
now proceed with the specification of our framework. 


3 Approximation of Correlated Markov Processes 


In this section we illustrate two new approximation schemes based on tensor algebra for correlated Markov 
processes where dynamics are expressed by the SDE in eq.(8). The novelty we introduce in these approx¬ 
imations involves the characterization of the cross space among dimensions using tensor algebra and in 
the introduction of new concepts like the copula infinitesimal generator, correlated tensor representation, 
conditional infinitesimal generator and parametric copula functions mapping. The proposed schemes we 
develop are based on tensor algebra which makes them highly amenable to address problems in high 
dimesional state spaces for correlated processes. The approximations involve: 

1. Direct approximation of the infinitesimal generator A with particular emphasis on its mixed deriva¬ 
tives terms; 

2. Decomposition of the infinitesimal generator A into orthogonal components. 

In what follows we hrst illustrate the SDE approximation for d = 1, in order to establish some 
useful notation and the building blocks of the approximation schemes. We then present the details of 
approximations of correlated processes when d > 2. 

In order to approximate a one dimensional process, we construct a state space X C U with n G N 
elements and define the sets of such stencils by 


X := {x 


2^2n 2 ^^ 1 

~ ^ := X2,.. 




22n 

2n 


x} and X° := X\5X, (17) 


with h = P a, positive constant that represents the discretization unit, and where the boundary 9X 
consist of the smallest (i.e. x) and largest (i.e. x) elements in X, possibly a countably infinite set, and 
the interior X° is the complement of the boundary. We denote by 7r„ : U —>■ X the bounded linear 
transformation from the continuous state space to the discretized one. 

It is possible to construct the continuous time Markov chain X^C := {X^}t>o as the discrete approx¬ 
imation of X on X by building a matrix A^ ”) = {a(xi,Xj)}, = l,...,22"+i -|- 1 = TO, that is the 

discretized counterpart of A in eq.(7) and each entry can be calculated by solving the following system 
of local moment matching equations: 


a{xi,X2) = a{Xm,Xm-l) = 0, 
a(xj,Xj+i) = i 

a{x^,x^-l) = i 

a{xi,Xi) = -{a{xi,Xi-i) a{xi,Xi+i)), 



(18) 
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Approximation of Correlated Markov Processes 


for alH = 2,..., 2^”+^, with —^-7^ < b{xi) < However, the discrete state space X does not need 

to be uniform and alternative discretization routines are presented in [38]. 

Remark 1. In the following we will denote by := A^ff\b{xi),a{xi)), i = the 

approximated infinitesimal generator for the Markov process X with local parameters /i(-) and cr(-). In 
particular A^^j^ is the approximated infinitesimal generator for the Markov process Xf^. Furthermore, 
given a process Xk we will denote by the vector corresponding to its discrete state space, in a similar 
fashion as X in eq.(17). 

Assumption 1. Note that for x S dX, for computational aspects, we impose an absorbing boundary 
condition. However, it is important to choose the boundary states sufficiently in the extreme of the state 
space that the laws of the processes X^C QfiPi X are close to each other during the finite time interval of 
interest in the approximation. 

The resulting matrix is a tridiagonal matrix in , rn = 2^"+^ + 1, with always positive 

extra-diagonal elements. The previous system calculates the entries of the generator by specifying the 
first and second instantaneous moments of the process X^'C that have to coincide with those of X on the 
set X°. This is equivalent to satisfy the following conditions 

^xA{Xt+At - XtY\ = ExAiXfYAt - + o{At), z e {1,2} and G H°. (19) 

Furthermore, one could in principle produce more accurate results by matching higher instantaneous 
moments of the process and in general there will be a trade off between the number of local moments 
matched and the coarsity of the grid/stencil h. 

The numerical problem we face is of the same type as in eq.(6) and its analytic solution is Ut = e*^v 
and represents the transient probability of a Markov chain with n states. 

We are now in a position to introduce the approximation schemes when d> 2. Let G de¬ 

note the approximated infinitesimal generator for the continuous Markov process k, with k = 1,2,... ,d. 
This notation is useful when describing d correlated processes and the unique approximated genera¬ 
tor for the multidimensional process. Each matrix A^*^ is tridiagonal and its entries calculated using 
instantaneous local moment matching as described in in equation (18). 

The representation of the infinitesimal generator for correlated Markov processes given in eq.(7) can 
be rewritten as 




* j 


dxidxj 2 


* j 


dxidxj 


Now denote this operator in two components. 


( 20 ) 


d 1 9^ 

Ax^,...,Xd ■= + 7)'^aij{t,x) 


l^j 


dxidxj ’ 


( 21 ) 


and 

A^ - ^ V g (t x) 
^x„...,Xd - 2 

then we can rewrite Lt in eq.(20) as the sum of two linear operators 


( 22 ) 


Lt — Ax^,...,Xi + A^Yl,...,Xa- 


(23) 


In particular Axi^...,Xd i® continuous operator for the independent Markov processes Xi,..., X^, while 
A^l Xd i® continuous operator just for the dependence structure of such processes. 

Next we develop two ways to approximate eq.(20) on a discrete multidimensional space 
namely: 
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Approximation of Correlated Markov Processes 


1. With direct approximation of the operators ..., within the orthogonal dimensions and 

the operator ^j-Qgg spaces. This approach directly approximates the cross derivatives 

operators and their action over the cross state spaces; 

2. The operator is approximated only over the orthogonal spaces. This is possible through the intro¬ 
duction of the notion of conditional operator =a a S Xj and i A jC = 1,. • •, d. 

Definition 2 (Multidimensional approximated generator). The multidimensional approximated generator 
for n independent Markov process {Xi(t)}t>o, for i = l,...,d with approximated generators Ai^'‘^ G 
l^rifexnfc ^ p = 1^2 ,... ,n is the nin 2 • • • x nin 2 • • • n^, matrix 


j (ni-'-rid) 



(24) 


Proposition 1 (Joint generator I). Let Xi and X 2 he two Markov processes with associated approximated 
infinitesimal generators ^^x^^ respectively. It is possible to define a factor Z, a Markov process 

that acts instantaneously on the spaces (Xi,X 2 ) with generator such that the infinitesimal ap¬ 

proximated generator of the correlated processes (Xi, X 2 ) with local correlation parameter p := p(Xi, X 2 ) 
can he written as 


aCi^2) 

^Xi,X2 


= A 


("1) 

Xi 


© A 


("2) 

X 2 


+ 41 


(c)(nin 2 ) 

Xi,X2 


(25) 


where 


+ l{p>o} ® ® 14 )) 

+ i{p<o} 


Furthermore eg. (25) can he rewritten differently instead as a conditional structure given by 


A 


(nin2) 

Xi,X 2 


= A 


(«i) 

Xi\z 


©x 


("2) 

X 2 IZ 


_|_ ^© 1 " 2 ) 


(27) 


Proof. First we consider the mixed derivative terms in eq.(22) when d = 2. For positive correlation the 
following approximations hold for finite element approximations for the partial derivative operators, 


df 

dxidx2 

df 

dxidx2 


(AL\ _ (AL\ 

j ^ /i+l_j_l_l — /i+ij — fi,j + l + fi,j 


Ax-] 


AxiAx2 


(Al] _ (ai_] 

/ i,j-l _ fi,j — fi,j-l ~ fi-l,j + /i-l.i-l 


Axi 


Axi Aa ;2 


+ 0(Aa:;i) + 0(Ax2), (28) 

0(Aa;i) + 0(Aa;2). 


Equations (28) can be combined to yield, 


dfij _ /i+l,j-|-l fi-ei,j {fi,j—l ‘^fi,j © fij-ei') 

dxidx2 2Aa:iAa:2 

Note the same scheme applies for negative correlation, 
following three terms T3 — (T1 + T2), where 


4JA±AJA_J.+o( Ax?)+0( Axi)+CI( Axi Aa:2) 

(29) 

However eq.(29) can be decomposed into the 


Tl 

T2 

T3 


fi-\-lJ ‘^fi.j © l,i 

2 AxiAx 2 ’ 

fi,j + l ‘^fi.j © fi.j—1 

2 AxiAx 2 ’ 

/i+lj + 1 2/ij + fi—lj—l 

2 AxiAx 2 


(30) 


7 of 24 














Approximation of Correlated Markov Processes 


Next we observe that the operator is a ‘correlation’ operator acting on the joint discretized 

product space Xi x X 2 . The term T1 acts only along the discretized support of Xi, the term T2 acts 
only along the discretized support of X 2 , while T3 acts only along the discretized cross support for both 
Xi and X 2 . We then use these finite difference operators to calculate the entries of the operators in 
eq.(26). In particular, we use the scheme T1 for the scheme T2 for and T3 for l{p>o} ® 

L^)(”i) + (g) . The magnitude of the local instantaneous intensities is p(Xi, X 2 )crXi, tTX 2 . 

We can therefore rewrite eq.(25) as 


.(nma) _ 
^Xi,X 2 - 


+ 

+ 


diag(/^"^^ (g diag{L^z^^)) 
i{p>o} ® ® 

i{p<o} 0 4^”^^ + 0 4^0^ 


(31) 


If we define the following operators, 

/i("i) _ f aCO tCi)\ 

^Xi\Z — 1 ^X 1 b 

4("2) _ ( AC 2 ) T{n-2)\ 

^X2\Z — y^X2 ^Z b 

4 ”^-) = -diag(/(-) g d^ag{L^-^^)) + l{p>o} 0 0 4^0 

+i{p<o} 0 + 4^^”^^ 0 4^0 ■ 


This proves eq.(27). 


□ 


Proposition 2 (Multivariate Uniform Distribution Infinitesimal Operator). The operator 

the infinitesimal generator associated to a bivariate correlated distribution with uniform marginals. 

Proof. Let’s consider the operator in eq.(26) acting on the joint Hilbert space HxiX 2 = Hxi 0 

Hx 2 - Without loss of generality we consider the structure of the approximated infinitesimal operator 
when p > 0, and we note that the case with p < 0 is identical. In this case the operator is given by. 


.(c)(nin 2 ) 

^Xi,X 2 


0 4"'^) - diag(/("i) 0 dm5(4"'^)) + (4'^ 0 4™^^"'^ + 4^^”'^ 0 4'0 ’ 


and it is a linear function of the operators L 


("1) 

z 


and L^z^^ 


that act on the spaces Hxi and Hx 2 respectively. 


□ 


Proposition 3 (Conditional Infinitesimal Generator). Let the infinitesimal generators of generalized 
diffusions {Xi(<)}t>o, f = 1, 2 ,... be 


^Jcj(2;) =b*{a;)^^0^CTf(a:)^^^, z= 1,2,... 

and with general and local properties as described in section 3. Let’s assume that the diffusions {Xi(t)}t>o, i = 
1 , 2 ,... are locally correlated with instantaneous local covariation given by 

(^a-i{x)dWi{t),a-j{y)dWj(t)'j = ai{x)aj(x)pij{x,y), for all ij = 1,2,... (34) 

In order to introduce the concept of conditional infinitesimal generator, without loss of generality, we 
consider the 2-dimensional operator. 


Lt — Axi,X 2 + 4!,X2 


(35) 
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being the d-dimensional case just an algebraic extension. We will make all the necessary dimensionality 
considerations for the d-dimensional representation. Therefore let’s consider the processes pair Xi = X 
and X 2 = Y. The conditional approximated infinitesimal generator A^f^^y defined by the sequence of 

operator matrices ^A^ff^y^y ^ pj € Y each of whose entries are obtained according to local 

moment matching by: 


4 (" 1 " 2 ) 

^xpX2=yj 


a{xi,X 2 ) = a{Xm,Xm-l) = 0, 

"ii+l j — 2 h J ^ 

, . 1 / ^?(..)(i-p^,(x.,v,)) mCMpMx.,yT^{v-V2(vT) \ 

Xi_i; — 2 1 /j 2 ^ I) 

a{xi, Xi) = -{a{xi, Xi-i) + a{xi, a;i+i)), 


(36) 


for all pj € Y, Xi € X, with < yif.[xi) < Jqj. fc = 1,2, -1 < pi 2 {xi,pj) < 1, and 

a{xi, Xj) >0 for all i A j- 


Proof. Let’s consider the Markov processes pair (Y, Y) and how to derive its corresponding infinitesimal 
generator approximation in matrix form. The local instantaneous intensities are calculated in the same 
way as described in Section 3 for the one dimensional case, namely using local moment matching as 
reported in eq.(19). For the 2-d case the instantaneous intensities are calculated using the local transition 
kernel 

piXt+^t,Yt+^t\Xt,Yt), asAt^O. (37) 

In particular considering the local states Xi € X and pj S Y the transition probability in eq.(37) can be 
rewritten in local form as 


p{x^+i,yj+i\x^,yj) = p{xi+i\pj+i,x^)p{pj+i\pj), (38) 

where 

(Yt+ = yj+i\Yt = yj) ~ p{pj+i\pj) = N(^p{pj),a^{pj)^ (39) 

(^Xt+ = x^+i\Yt = yj+i,Xt = Xi^ ~ pixi+i\yj+i,x^) (40) 

= N(^p,{xi) + '^^^p{xi,yj){yj - piyj)),{l - p'^{x„yj)a'^{x,))^ 

The calculation of the matrix entries for is done in identical way as described in Section 3, 

imposing the instantaneous moments of eq.(40) for all pj S Y and this completes our proof. Extension 
to dimensions larger than two is straightforward due to independence of each conditional operator. □ 


From proposition 3 it is clear that we can represent the approximated multidimensional generator of 
eq.(24) as a decomposition of independent conditional generators. Furthermore it is also possible to exploit 
standard results of conditional probability partitioning in order to facilitate the local characterization of 
the independent multidimensional conditional generators. Given a multivariate gaussian variable X ~ 
N{fi, S) and consider the partition of X and equivalently of fi and S into 


X = 




Si,i Si ,2 
^2,1 ^2,2 


(41) 


Then {xx\x 2 ) — y = x^ -\-Cx 2 , where C = —Si, 2 ^ 2^21 conditional distribution of the first partition 

given the second, is Nfp, S), with mean 

/I = /ii + Si, 2 S 2 , 2 ( 3^2 — A*2), (42) 

S = Si,i + Si,2S2,2S2,1. (43) 
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More generally if we denote by S the covariance matrix introduced within the definition of the operator 
in eq.(7), and by X ^ A^(/x, S) a multivariate normal vector, and fixed t > 0 the covariance matrix 
S = {aij{t,x)} G of equations (7), (20) is 


/Si,i 

Si ,2 

■ SiA 

^ 2,1 

^ 2,2 

Ti 2 ,d 


Sd ,2 • 

'T‘d,d) 


(44) 


Conditional probability partitioning is a very important property when creating the sequence of 
conditional approximated generators as in eq.(36) because large multivariate Gaussian vectors can be 
easily partitioned as the combination of sets of independent sub-multivariate Gaussian vectors. Each 
of the sub-multivariate Gaussian vectors can be further characterized and locally approximated through 
a principal component analysis (PGA). Therefore it is possible to construct a reduced dimensionality 
infinitesimal generator of a large dimension process without an aggregate PGA of the global process 
covariance structure. 


Example 1 (3-D approximated generator). Given the results in propositions (3) we show how to calculate 

express the approximated 3-D generator under a conditional decomposition 

according to 


.(nin2n3) 
^X 1 X 2 X 3 


aCi) 

1 X 2 X 3 


© A 


("2) 

X 2 IX 3 


©A 


(« 3 ) 
^3 • 


(45) 


Note that 


with X 2 G X 2 and X 3 G X 3 . 


Proposition 4 (Joint Transition Kernel I). The transition kernel solution of the Cauchy problem in 
eq.( 6 ) for the infinitesimal generator in eq.(25) is given by 


X 2 ) = p("i”^)(Xi, X 2 ; p = (Xi, X 2 ; p)=Y^ ^^(Xi |Z) © P(Xi|Z)P(Z) (46) 

z 


Proof. Due to the linearity of the operator in eq.(27) 


"^Xi,X2 


= A 


(«i) 

Xi|Z 


©A 


("2) 

X 2 IZ 


+ A 


(ni"2) 
Z > 


(47) 


we obtain 


= qXiIZ^^X2\zX^Z > 

g XilZ'^ X2lZ^^Z 

z 


(48) 


which proves the rhs of eq.(46). Analogously the linearity of the operator in eq.(25) implies 


4('>l"2) 
e xi,x 2 




= e 


X 2 




A f 


(c)(ni7Z2) 

. (c)(nin2) 
^1-^2 


(49) 


which proves the Ihs of eq. (46). Due to the equivalence of the operator representation in eq.(25) and 
eq.(27), this proves equivalence of the transition probability kernels in eq.(46). □ 


Lemma 1 (Equivalence of the joint representations). Given two correlated Markov processes Xi and 
X 2 the approximated joint transition probability kernel {Xi,X 2 ) is the solution of the Cauchy 

problem of eq.( 6 ) where the infinitesimal operator can be expressed in either cross space and marginals 
decomposition or as conditional decomposition given by 


(nin2) 

Xi,X2 


= A' 


^X2 ^ 


+ A 


(c)(nin2) 
Xi .X 2 ’ 


(50) 


or 


A 


(nin2) 

Xi,X2 


= A 


(«i) 

X 1 IX 2 


©A 


("2) 
X 2 ■ 


The approximations in eq.(50) and eq.(51) are equivalent. 


(51) 
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3.1 Functional Copula Constructions 


Theorem 3 (Correlated kernel tensor representation). Given m correlated Markov processes the ap¬ 
proximated solution of the martingale problem of eq.(l) is given by the product measure representation 
involving the generator decomposition given according to, 




it) = 


tA 


("i) 

XPX2.....X-. 


(g) e X2\X3.-...Xm 


tA 




(52) 


Proof. In order to calculate the m-dimensional solution of eq.(52) we exploit the orthogonality of the 
conditional approximated infinitesimal operators ^ for all i. This follows from propositions 3. 

Then the transition density of eq.(52) is computed as illustrated in example 1. □ 


It is important at this stage to introduce the explicit expressions of the quadratic variation and qua¬ 
train covariation among CTMC with generators approximated using the method introduced in proposition 
(3). 

Lemma 2 (Orthogonal CTMCs). Let X = be a d-dimensional CTMC and define its 

partition as X = [xi,X 2 y. Let’s denote define y — x^-\- Cx^, where C = —'Sx, 2 ^ 2 ^ 2 - Then the chains 
X 2 and the conditional chains y are orthogonal and var(xi\x 2 ) = var[y). 


Proof. We want to show that the instantaneous covariation of the chains X 2 and y is zero. Therefore we 
compute 


Furthermore we have 


cov{x2,y) 


COv{x2,Xi) -\- COv{x2,Cx2) 
Si,2 + CcOy{x2,X2) 

Si,2 — Si,2S!2,2S2,2 = 0 


var(a:i|a:2) 


var(a:i -f CX 2 ) 

var(a:i) -|- Cvar(a; 2 )C' -I- Ccov(a;i, 3 : 2 ) -f C 0 Y{x 2 ,xfi}C' 
var(y|a: 2 ) = var(y). 


(53) 


(54) 

□ 


Given the results from proposition 3 and Lemma 2 with some algebra it is straightforward to obtain the 
covariance matrix S. We have 


[y, X 2 ] 


s 

0 



y 


X 2 


[X 1 ,X 2 ] 


51.1 

52.1 



Xl 

X 2 


(55) 


3.1 Functional Copnla Constructions 

We are interested in generating joint distributions with a variety of dependence structures and to achieve 
this purpose we use copula function specifications. In what follows we explore how copulas and families of 
copulas are generated and introduce a general approach to construct copulas in a tensor product space. In 
particular we show how copulas are related to other methods of generating joint distributions in a Hilbert 
space based on specified marginal tensors and decomposition properties of the product space. In doing 
this we exploit some desirable convergence results of the proposed transformed tensor representation of 
multivariate correlated processes to the continuous copula functions. 

After the definition of a copula function we recall Sklar’s theorem, a fundamental result about the 
relationship between marginals and joint distribution for multivariate correlated random variables. This 
is important to recall as we will develop a new characterization of Sklar theorem as a function generator 
representation. 

Definition 3 (m-Copula Function). An m-dimensional copula (or m-copula) is a function C from the 
unit m-cube [0,1]"* to the unit interval [0,1] which satisfies the following conditions: 

1. C(l,..., 1, a„, 1,..., 1) = a„ for every n < m all a„ in [0,1]; 
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3.1 Functional Copula Constructions 


2. C{ai,.. .,am) =0 if an = 0 for a„ < a^; 

3. C is m-increasing. 

Remark 2. Property 1 says that if the realizations of m — 1 variables are known each with marginal 
probability one, then the joint probability of the outcomes is the same as the probability of the remaining 
uncertain outcome. Property 2 is sometimes referred to as the grounded property of a copula. It says that 
the joint probability of all outcomes is zero if the marginal probability of any outcome is zero. Property 
3 says that the C-volume of any m-dimensional interval is non-negative. Properties 2 and 3 are general 
properties of multivariate cdfs. It follows that an m-copula can be defined as an m-dimensional cdf whose 
support is contained in [0,1]"* and whose one-dimensional margins are uniform on [0,1]. In other words, 
an m-copula is an m-dimensional distribution function with all m univariate margins being U(0, 1). 

The relationship between distribution functions and copulas is given by the following result, see [?]. 

Theorem 4 (Sklar’s Theorem). Let X and Y be random variables with distribution functions F and G 
respectively and joint distribution function H. Then there exists a copula C such that for all (x,?/) € KxK 


H{x,y)=C{F{x),G{y)) (56) 

If F and G are continuous, then G is unique; otherwise, G is uniquely determined on Ran(F) x Ran(G). 
Conversely, if C is a copula and F and G are distribution functions, then the function H defined by (56) 
is a joint distribution function with margins F and G. 

By Sklar’s theorem, given continuous margins Fi and F 2 and the joint continuous distribution function 
F{xi,X 2 ) = C{Fi{xi), F 2 {y 2 )), the corresponding copula is generated using the unique inverse transfor¬ 
mation 

C(ui,U2) = CiF{xi),F2ix2)) = F{xi,X2) = F[FF\ui),F^\u2)), (57) 

where ui and U 2 are standard uniform variates. Given the result in theorem 3 it is possible to extend 
it to the representation of joint distribution function using tensor algebra. Without loss of generality 
we present the result in two dimensions. Extension to higher dimensional case is straightforward by 
induction. 

Proposition 5 (Sklar’s Theorem in Generator Space). Let X 2 )(<), t > 0, be the approximated 

transition probability kernel solution of the martingale problem in eq.(l) for the infinitesimal generator 


H.) = 


(58) 


Then the approximated joint distribution function for the process starting at (xi,X 2 ) is given by 
4';;”^^)(Xi,X2|Xi = ii,X2 = X,) = 47)(Xi|Xi = G 4";)(X2|X2 = x,) 

Proof. 

p44(Xi, X 2 IX 1 =x„X 2 = X 2 m = (e<’‘ G 

= p4^(Xi|Xi = X,) G p4)(X2|X2 = X 2 ) 

due to the conditional independence of the marginal tensors. Then 


(59) 


(60) 


^ P(xf4i = Xl) G £ P{xf\X 2 =X 2 ) = p44(Xi,X2|Xi = x„X 2 = X 2 ). (61) 


□ 
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3.1 Functional Copula Constructions 


Due to the general validity of our result we can proceed to formulate it in the following theorem. 


Theorem 5 (Joint Distribution Function Convergence). Let Xi{t) and X 2 {t) be correlated Markov pro¬ 
cesses with marginal distributions Fxi and Fx 2 and approximated joint distribution function (Xl,X2) 

as in eq.(59). Let C{ui,U 2 ) : [0,1]^ i—>■ [0,1] a continuous copula function. Then the following eonvergence 
result holds 


lim 

Til ,n 2 —>-oo 


p("l"2) 

^XuX2 


{X^,X2) = C{FxAXi),Fx2{X2)) 


(62) 


Corollary 1 (General Copula Mapping). Let - ) ^ x ... where i = 0,...,ni and 

j = 0, ...,n 2 and so on, denote the discretization of the unit hypercube. Let C'^^'^'^{ui,Vj) be a copula 
distribution function defined for all {ui,Vj) € Then according to theorem 5, the following 

equalities hold: 


Furthermore, if we denote by 6 the set of the copula parameters, and by p the set of local cross space 
parameters for the approximated tensor representation, then given (^f'^^\x^P),F^^\xY^)',9^ , 

its equivalent representation in a tensor space is given by 


min 

p 




(64) 


Eq. (64) means that for a given parametric copula distribution function C belonging to any copula family 
it is possible to find a set of local parameters p that would produce a joint distribution function F that 
has minimal Euclidean distance from C in the tensor space. A practical way to solve eq.(64) is to compute 
the local likelihood with respect to the set of parameters p = {pij} such that 

min I log (Ctarget(Mi, Wj; 0) “ Fx^xl^ Fx 2 ^ for all i,j. (65) 


where Ctarget can be any target copula function. 

Theorem 6 (Copula Infinitesimal Operator). Let {ui,Vj) be a copula density function defined for 

all (uijVj) G L)CiW 2 )^ Given the result in theorem 5, we have that 


c(”i’”")(Efoi)(^*(^))’'^x"2)(a;f))) = for all i,j. 


( 66 ) 


with infinitesimal operator given by eq.(26). 

Theorem 7 (Copula Tensor Representation). Given the tensor product basis Z = Bx®By associated to 
as in eq.(50), where Bx and By denote the basis of the operators and respectively, 

it is possible to specify a point (xi,yj) G (X, Y) with corresponding associated subspace {M 0 M^) C Z 
of the direct sum of vectors x G M and y G with origin {xi,yj), such that the following relations 
hold, 

z = x(By (67) 

and 

z = z' + z" = {x ® y) + (—a 0 —a"*-), (68) 

where the vector a is the shared component among the vectors x and y or the instantaneous local covariance 
part of the joint process [Xt,Yt) and represents the copula. Eq.(67) and eq.(68) are represented in fig. (1). 
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M 



Figure 1: Representation of z = z' -h z" = {x (B y) + {—a © —a-*-). 
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Convergence of the Approximated Generator 


4 Convergence of the Approximated Generator 

(n) 

In section 3 we defined the Markov chain approximating the multidimensional generalized diffusion 
Xf. Here we present weak convergence results for to the solution of the SDE for Xt, introduced 
in eq.(l). The convergence is studied from different perspectives: first from a semigroup point of view, 
secondly in a spectral way through a Fourier unitary transformation of the approximated generator, and 
lastly through the martingale problem for the associated infinitesimal generator. 

We want that the continuous Markov chain X^C ;= {Xf}t>o has a dynamics as close as possible to 
the corresponding approximated process {Xt}t>o- At this purpose we can define an error 

e„(/) := sup - Af{x)\\. (69) 

xGH 

Using the semigroup approach to weak convergence we can state that, if en{f) tends to zero as n tends 
to infinity for / in V, then the sequences of processes X^C^ converges weakly to X, in the space De- 
The space De, is the space of right continuous functions / : E — K with left limits, see Ch. 5, pp. 115 
of [39] for more details. The following theorem states that if the error e„(/) goes to zero as n tends to 
infinity, implying norm convergence of the approximated generator to Af{x), this would imply 

also convergence of the corresponding approximated semigroup to Ptf and of the chain X^'C to X 
for t > 0. 

Theorem 8. Let X be a Feller process with state space E and infinitesimal generator A satisfying the 
properties and assumptions defined in section 2, and X^C ftg a sequence of Markov chains with generator 
matrices A^C _ Then it holds that 

lim e„(/) = 0 (70) 

n—¥oo 

for every function f in the core of A, which is equivalent to the statement that 

Pt'^'^T^nf Ptf, for all f G C'o(E), t > 0. 

Then the sequences of processes X^C^ converges weakly to X, in the space De- 

Proof. From Theorem 6.1 in Chapter 1 pag. 28 of [39], we have that if Pf^\ n = 1, 2,.. ., and Pt are 
strongly continuous contraction semigroups on Bn and B with generators A^C and A respectively, and 
let I? be a core for A, then the following are equivalent: 

(i) For each f G B 

^ Ptf 

uniformly on bounded intervals. 

(ii) For each f G B 

Pt^^^TTnf -G Ptf 

for all t > 0. 

(hi) For each f G D, there exists /„ G D{A^C'^ {D{A^C^ is the domain of A^C ) for each n > 1 such 
that fn-^ f and ^ Af. 

Furthermore, following [39], Chapter 4 pag. 172 Theorem 2.11, we have that if Pt is a Feller Semigroup 
on C'o(E) and that for each t > 0 and / G C'o(E) 

^ Ptf. 

in) 

If Xg has limiting distribution v, then there is a Markov Process X corresponding to Pt with initial 
distribution v and sample paths in Dp, and 

^ V in Up. 


□ 
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Convergence of the Approximated Generator 


Therefore, in order to be able to use the result of theorem 8, we just need to prove the convergence of 
the proposed approximated generator and this is done in the following theorem. 

Theorem 9. For all f € V, with T) core of the generator A as previously defined, 

lim sup - Af{x)\ = 0 

This mode of convergence is called strong convergence. 


Proof. Let f G T> and cc G H, and h := Ax G K the discretization unit. We can locally write the 
generator of the semigroup as 

A^^'^f{x) = a^'^\x,x + h)(^f{x + h)- f{x)^ + a'^‘^\x,x- h)(^f{x - h) - /(x)) 

By Taylor approximation 

fn{x) ~ f{x + Ax) « /(x) + /'(x)Ax + i/"(x)(Ax)^ + o((Ax)^) 


we obtain for all i = 
A^^^fnix,) = 
+ 


+ 


1,2,..., X, G H, 

a(xi, Xi+i)(^f{xf) + f\xf)Ax + i/"(x*)(Ax)^ + o((Ax)^) - /(xi)) 
a(xi, Xi-i) (/(xi) - /'(xi)Ax + ^/"(x*)(Ax)^ + o{{Axf‘) - /(x*)) 

f {xi)Ax{a{Xr,Xr+i) - a(xi,Xi_i)^ + ^/"(xj)(Ax)^(^a(xj,Xi+i) - a(xi,Xi_i)^ 
^u(x2, X^-i-i ) Q.(Xj, Xj_ 1 c>((Ax) ). 


Due to the fact that f gV, the error term o((Ax)^) is uniform in x. We have that 


a(xi,Xi+i) + a(xj,Xj_i) 
u(Xi,X^-|_i) u(Xj,Xj_i) 


CT^(Xi) 
/l2 ’ 

g{xi) 

h ■ 


In section 3 we made precise assumptions, see 1 on the behavior at the boundary of the process. Without 
loss of generality we can assume that the boundary is at a point of infinity, i.e. not attainable in finite 
time and it is furthermore absorbing. It is possible to express T*^"^/„(x) for all x G H, as 





Af{x) + [^)oi{Axn 


We obtain 

sup |A„/(x) - Af{x)\ = sup |^^^o((Ax)^)| = C'io((Ax)^) 0. (71) 

xGH xGH ^X 

In case the elements of 9H, consisting of the smallest (i.e. x) and largest (i.e. x) elements in H, are 
absorbing states of the Markov chain we can continue the above analysis with a further investigation of the 
weak convergence. Furthermore the behavior on the boundary of the functions f G D is f'{x) = fix) = 0. 
For Xi = X we have. 


|A(")/(x)-Gl/(x)| < 

+ 
+ 


|yl(")/(^)-A(")/(x + h)| 
\A^^^f{x + h)-Afix + h)\ 
\Af{x + h)- Afif)\ 
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The second term tends to 0 as shown above, the third term by continuity of Af in x. For the first term 
we have 


\A^^^f{x)-A^^ffix + h)\ 


\a{x,x + h){f{x + h) - f{x)) 
a(x + h, x){f{x + 2h) — f{x + h)) 
a{x + h,x-\- 2h){f{x + h) — f{x))\ 
0 {n)o{h) 0. 


since a{x,x + h), a(x + h, x), a(x + h,x + 2h) are on order n and {f{x + h) — f{x)), ifix + 2h) — f {x + h)), 
{f{x + h) — f{x)) are of order o(/i) because f{x) = 0 for / G _D. The result for x follows in the same 
way. □ 


4.1 Correlated Diffusions Approximation Convergence 

For this purpose we need to introduce multiplication operators that are considered as an infinite-dimensional 
generalization of diagonal matrices and they are extremely simple to construct. Furthermore, they appear 
naturally in the context of the Fourier transform or when one applies the spectral theorem and deals with 
spectral representation of operators on Hilbert spaces. It is an equivalent way to represent the same 
operator and can be useful for calculations and further analysis. 

We recall that the definitions of discrete Fourier transform matrix and its inverse as a unitary operator 
are given by. 


= 


Fi,kFf.j 


-1 

k,s 

-1 


/n 


/n 


= 


where Sij is the Kronecker delta, so these matrices give the resolution of the identity matrix and define 
a unitary transformation. Also, if f{x) is a function belonging to the space and B„ be the Brillouin 

zone defined as | ^ kh, fc = 0,..., = ^ | the transformation Fn ■ T^(H) i-G- L'^{Bn) 


W){s) = Y, Fs,kfix), 


is the discrete Fourier transform of /, with H := hZ ^ . In fact. 


= 



(72) 


(73) 

(74) 


where h = ^. We now extend the above transformation to the d-dimensional case, and the following 
results set the notation for our subsequent theorems and proofs. 

Lemma 3. For any nonnegative-definite symmetric matrix A the function 

tpx = exp ^ — i/xs — (75) 

is the characteristic function at time t > 0 of the random vector X with E[X] = p. and C'o?;[X] = A. 

is possibly unbounded but in all our practical applications we consider H C D [—K, A] C ffi, A € (0, oo), with D the 
operator domain and assuming for simplicity also periodic boundary conditions. 
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Theorem 10. (cf.[43], Th. 3.2.3) Let f{s) be an arbitrary characteristic function. For every real x the 
limit ^ 

P{x) = lim [ e-'‘'^f{s)dx (76) 

1 Z1 J 

exists and is equal to the saltus of the distribution function of f{s) at the point x. 

We can obtain a spectral representation of the operator ^7 applying the above unitary 

transformation leading to the following diagonal operator, 

qn,-nAs) = (/)).F-1(S^ S) (77) 

where the approximated operator of eq.(24) can be written as 

(78) 


with V the discrete d-dimensional operator gradient and H the discrete d-dimensional Hessian operator. 

In order to derive some converge properties of the operator (24) we do this by comparing the spectral 
representations of the probability density functions for the continuous infinitesimal generator and its 
approximated counterpart, namely 


p(ni---nd) 


{x,y) 


1 

(27r)'^ 





and 

In this way we are able to assess the order of convergence of the error 




Pt{x,y) - P^'^^""^'^\x,y) 


(79) 


To assess the rate of convergence of eq.(79), we exploit the relationship between the distribution func¬ 
tion and its corresponding characteristic function and in particular we refer to the Continuity Theorem. 

Theorem 11 (Continuity Theorem, cf.[43], Th. 3.6.1.). Let {T'„(a:)} be a sequence of distribution func¬ 
tions and denote by {fn{s)} the sequence of the corresponding characteristic functions. The sequence 
{Fffx)} converges weakly to a distribution function F{x) if, and only if, the sequence {/n(s)} converges 
for every s to a function f{s) which is continuous at s = 0. The limiting function is then the characteristic 
function of F{x). 

We can therefore focus on the analysis of the passage to the limit h —>■ 0 of the following spectral 
representation, conditional on a time t, 


lim 


hio {2TT)d 




(80) 


Theorem 12 (Convergence of the d-dimensional approximated operator). For all x we consider the 
sequence of distribution functions '^‘^\x,y) and by {e'^^'i- sequence of the corresponding 

characteristic functions. The sequence {P„(a:)} converges weakly to a distribution function F{x) if, and 
only if, the sequence converges for every s to a function ipx. which is continuous at s = 0. 

The limiting function is then the characteristic function of F{x). 


Proof. We prove convergence and characterization of the rate of convergence for d = 1 and d = 2 being 
the proof in higher dimensions just an algebraic extension of the case of d = 2. The calculation of 
qni-.-ndi^A is straightforward and it is just an application of the shift theorem. For d = 1 

-^n(47^)(/)W = E Fs,k{gyhAf)A) + ^Af^AfAx)) 
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4-1 Correlated Diffusions Approximation Convergence 


f{kh + ff)- f{kh-hi) 


x^U 

n—1 


= Fsg 


fe=0 


2 hi 


2 hi 


n—1 


n—1 


(e*'*^* ^ Fs,kf{kh) - Y 


gi/iis _ ^—ihis 


/c=0 




Doing a similar calculation for A;^J(/)(s) we obtain 


, , / . sin/iis ,cos(/iis) — 1 \ , , 

g„,(s)= - +a^ J -)(s). 


hi 


hi 


We have 


Pt\x^y) = < Xt < y + hi\XQ = x) 


ni 


E 

seB„ 


:,qr^l(s)t is(y-x) 


(81) 


Without loss of generality, this result is a particular case of the continuity theorem (11), and the conver¬ 
gence error of eq.(79) is measured in correspondence of saltus point of the distribution, see Th.(lO). Lets 
consider the integral on the left end side of eq.(80) for d = 1 and it can be rewritten as 



and it is possible to make the first and the third integral on the right end side arbitrary small by choosing 
a large number K > 0 and by selecting hi > 0 sufficiently small. If we consider the second integral we 
can analyze the behaviour as hi —^ 0. We notice that the function 


and 


lim 

hi —>^0 


(. sin/iis 


ssmhis 

hm ig -,- 

hl -^0 s hi 

sin/iis 

hm isg —;- = isg 

hi^O his 


lim 

/ii—>-0 


, cos his — 1 
■ d? 


= lim a' 
/ii-s-o 


cos/lis — 1 


lim cr^s^ 


hi 

cos his — 1 

{hisY 


^22 

--as. 


We would like to examine in more details the order of convergence of the above functions as hi —>■ 0. For 
the limit 

sin/ll 

hm —— = 1, 

hi —>^0 
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4-1 Correlated Diffusions Approximation Convergence 


using sin hi = hi —we get 

sin/ll ^ sin/ll —/ii h\ 
hi hi 6 h 



+ ... 


h2 

we find an order of In the same way using cos hi = 1-^ we can assess the order of 

convergence of the limit 

1 — cos hi 1 

1 —cosh 1 

hf ^ hf ^ 2 

and convergence order of 0(1). Therefore the order of convergence is at most 0{h\). This results can be 
extended to all the marginals of a d-dimensional approximated operator in case of independent marginals. 
In the presence of correlation we have the presence of mixed derivative terms. For d = 2 the calculation 
of qnin 2 is as follows: 

2 2 

= '^2 ^2 + h2'^h2 + -^^h2 + P^1^2"^hi'^h2){f){x2j . 

xiGXi 212 ^X 2 


Eq. (82) is equivalent to 


^-(^5?’ ® + AAT') (/)(») = .f-.(-4S’) (/)(») ® 

Therefore it is sufficient to analyze the term 

^~(4i!r’’) (•()(*)■ 


+ Dn 




(c)(nin2) 

Xl,X 2 



(83) 


where the operator 


was introduced in proposition 1 as the correlation operator. 


(c)(nin2) 




)(/)(a) = E E Fs,k{p<Jia2Vh2^n2){f)ix)) 

Xl GXi 212 GX 2 

= pi 2 (Jia 2 -r-^( cos{hiSi + h 2 S 2 ) - cos{hiSi) - cos{h 2 S 2 )+ 1 ), (84) 

/ll/i2 ^ ^ 


because of the mixed derivative term approximation of proposition 1. The following approximations hold: 

h^Si h\s\h\s2 


COs(hiSi -I- h 2 S 2 ) - 1 
cos(hisi) — 1 
COs(h2S2) - 1 


‘2^2 




^2'^2 


— SiS 2 hih 2 — 


0 {hi)\ 


+ 


+ (l+hl+hf)0(h2)•'+0(h)^ 


0 {h 2 f 


(85) 


Therefore, 

lim pi 2 cri(T 2 v^ f cos(hiSi-I-h 2 S 2 ) - cos(hisi) - cos(h 2 S 2 ) + 1 ) = -Pi 2 ai<y 2 SiS 2 , (86) 

hx,h2^0 hiil2 ^ ' 

that is exactly the characteristic function of the covariance term for the bivariate normal distribution at 
time t. Given this proof, extension to higher dimensions is algebraically straightforward. □ 
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4.2 Weak Convergence of the Approximating Chain Using the Martingale 
Central Limit Theorem 

Here we present a weak convergence result for the multivariate diffusion approximation introduced in 
Section 3, along the lines of the general diffusion convergence Theorem 4.1 at pag. 354 of [39]. The 
convergence result we propose is based on the arguments belonging to the formulation of diffusion theory 
in terms of the martingale problem, see [40], which requires minimal assumptions about the smoothness 
of the coefficients of the SDE and can be seen as an extension of the martingale central limit theorem 
[Martingale CLT, Th. 1.4, [39], pag. 339]. The results are mainly obtained by compactness arguments 
which do not require a priori regularity. These arguments are the same as those devised to provide an 
existence theory for the multidimensional SDE under consideration, and they just refer to properties of 
the SDE coefficients, that are the prerequisites for our analysis as per section 2. 

Theorem 13. Let S = ((S^)) be a continuous, symmetric,nonnegative definite, d x d valued function 
on and let b : t be continuous. Let 

4 = {(/, G/ = i ^ ^ bAf) : / G G“(K'')} (87) 

and suppose that the Ggd [0, oo) martingale problem for A is well posed. For n = 1,2,... let Xn and Bn be 
processes with sample paths in Dg^d [0, oo) and let An = ((4^)) be a symmetric dxd matrix-valued process 
such that Afl has sample paths in Dji[0, oo) and Anit) — 4„(s) is non negative definite for t > s > 0. Set 
Tf = cr(^X„(s), Bn{s), 4„(s) : s <ty Let rf = inf{t : |X„(t)| > r or \Xn(t—)\ > r}, and suppose that 


Mn — Xn — Bn 


( 88 ) 


and 

MfMi - 

are Ff'-local martingales, and for each r > 0, T > 0, and i,j = 1,2,... ,d 


lim E 

n—>-oo 


sup 

£<TAt^ 


Xn{t) 


Xn{t-) 


2 l 


= 0 , 


(89) 


(90) 


and 


lim E 

n—)-oo 


sup 

t<T/\T:^ 


Bn{t) 




2n 


= 0 , 


lim E 

n—^oo 


sup 

t<T/\T^ 



Aliit-) 


2n 


= 0 , 


sup 

t<T/\e’^ 



bi{Xnis))ds 


Ao 


sup 



AjiXnis))ds 


Ao. 


(91) 

(92) 

(93) 


(94) 


Suppose that P{X^C(^Q'j i) 

=> v, with V the starting distribution. Then X^C X , with X the solution 
of the martingale problem for (A, u). 


Proof. Due to the fact that the martingale problem for A is well posed, the process M{t) = X{t) — B{t) is 
a martingale. By the optional stopping theorem, see [41], if r is a stopping time also M(r) is a martingale. 
In particular this is valid also for the stopping time rf = inf{t : A„(t)| > r or |X„(t—)| > r}. By 
eq.(88) the process Mn{t) = Xn{t) — Bn{t) is a martingale. Relatively compactness properties of Mn{t) 
implies relatively compactness of X„(t) and Bn{t) and therefore for X„(tAT„) and BnitAvn) as in eq.(90) 
and eq.(91) respectively. This extends also to the stopped martingale M„(f A A t^) where = infjt : 
4“(<) > tsup|,,| ^nau{x) + l,for some i}. Furthermore relative compactness in a set G is a condition 
equivalent to the condition that each sequence in G contains a convergent subsequence, see for example 
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[44]. This means that every subsequence Xn^it A r^) => X’'(t A r’'), where r’' = inf{t : |^’'(t)| > r}, for 
all f > r > 0 Therefore the stopped processes 


ptAr'^ 

M^t A = X^t A r^) - / 

^0 


ptAr 

Jo 

are martingales and by Ito’s lemma 


ptAr'^ 

fiXAtAA))- Af{XAs))ds 

JO 


(95) 

(96) 


(97) 


is a martingale for each / S C'))°(M‘^), and Af{X'^{s)) is the approximated infinitesimal generator applied 
to the function /. In particular if the martingale problem is well posed uniqueness argument for the 
solution hold and hold also for the solution for the stopped problem, hence 


XAtAA) ^ X{tAA) 


(98) 


for all r. Also r —>■ c» implies r’’ —>■ c». Therefore A„ —>■ X. 


□ 


5 Conclusion 

We have derived the properties for the operator representation of the multivariate dependence theorem 
attributed to Sklar which describes the unique representation of general dependence structures linking 
marginal distributions. This was developed in the context of multidimensional correlated Markov dif¬ 
fusion processes, in the process we defined the copula infinitesimal generator which we interpret as a 
functional copula specification of Sklars theorem extended to representations involving multivariate gen¬ 
eralized diffusion processes. This allowed us to develop a copula function mapping framework which we 
demonstrated can be accurately and efficiently obtained under a discretization scheme proposed. 

We als demonstrated that it is possible to represent, in both continuous and discrete space, that a 
multidimensional correlated generalized diffusion is a linear combination of processes that originate from 
the decomposition of the starting multidimensional semimartingale. This result not only reconciles with 
the existing theory of diffusion approximations and decompositions, but defines the general representa¬ 
tion of infinitesimal generators for both multidimensional generalized diffusions and as was demonstrated 
allows for a new functional copula characterization of copula density dependence structures. This new 
result provides immediate representation of the approximate solution for correlated stochastic differential 
equations. We demonstrate desirable convergence results for the proposed multidimensional semimartin¬ 
gales decomposition approximations in both a strong sense and weak sense, including explicit expressions 
for the rate of convergence of the discretized approximations. 
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